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Abstract 

Background: An interrupted time series design is a powerful quasi-experimental approach for evaluating effects of 
interventions introduced at a specific point in time. To utilize the strength of this design, a modification to standard 
regression analysis, such as segmented regression, is required. In segmented regression analysis, the change in 
intercept and/or slope from pre- to post-intervention is estimated and used to test causal hypotheses about the 
intervention. We illustrate segmented regression using data from a previously published study that evaluated the 
effectiveness of a collaborative intervention to improve quality in pre-hospital ambulance care for acute myocardial 
infarction (AMI) and stroke. In the original analysis, a standard regression model was used with time as a continuous 
variable. We contrast the results from this standard regression analysis with those from segmented regression 
analysis. We discuss the limitations of the former and advantages of the latter, as well as the challenges of using 
segmented regression in analysing complex quality improvement interventions. 

Findings: Based on the estimated change in intercept and slope from pre- to post-intervention using segmented 
regression, we found insufficient evidence of a statistically significant effect on quality of care for stroke, although 
potential clinically important effects for AMI cannot be ruled out. 

Conclusions: Segmented regression analysis is the recommended approach for analysing data from an interrupted 
time series study. Several modifications to the basic segmented regression analysis approach are available to deal 
with challenges arising in the evaluation of complex quality improvement interventions. 
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Background 

An Interrupted Time Series (ITS) study is a powerful 
quasi-experimental design for evaluating effects of inter- 
ventions when random assignment is not feasible [1]. In 
an ITS study, a series of observations on the same out- 
come before and after the introduction of an interven- 
tion are used to test immediate and gradual effects of 
the intervention. A major strength of this design is its 
ability to distinguish the effect of the intervention from 
secular change, that is, change that would have happened 
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even in the absence of the intervention. Estimating the 
intervention effect is done by comparing the trend in the 
outcome after the intervention to the existing trend in 
the pre-intervention period, and is achieved through mo- 
difications to the standard regression analysis. In a basic 
segmented regression analysis [2-4], the time period is di- 
vided into pre- and post-intervention segments, and sep- 
arate intercepts and slopes are estimated in each segment. 
Statistical tests of changes in intercepts and slopes pre- 
to post-intervention are carried out. By making a few 
simple changes to the data set-up and model specifica- 
tion, segmented regression analysis can easily be imple- 
mented in standard statistical software packages. An 
additional adjustment is usually required to account for 
serial autocorrelation, which arises because observations 
taken over time are usually correlated. Technical details 
for data preparation, model specification, and adjustment 
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Table 1 Segmented logistic regression analysis of care 
bundles for AMI and stroke: all sites combined 



Parampfpr 


Odds 
ratio (OR) 


rnnfiripnr p 

interval for OR 


n-va 1 1 ip 


AMI 








Pre-intervention slope 
(secular trend, per month) 


1.02 


0.96 to 1 .08 


0.542 


Change in intercept 
(immediate effect) 


1.03 


0.81 to 1.30 


0.787 


Change in slope 

(gradual effect, per month) 


1.04 


0.98 to 1.10 


0.198 


Stroke 








Pre-intervention slope 
(secular trend, per month) 


1.05 


1.00 to 1.10 


0.038 


Change in intercept 
(immediate effect) 


0.93 


0.75 to 1.14 


0.465 


Change in slope 

(gradual effect, per month) 


1.02 


0.97 to 1 .07 


0.517 



for autocorrelation are presented elsewhere [2,4]. Several 
examples of the use of segmented regression analyses in 
studies of quality improvement interventions have been 
published [5-7]. 

Illustration 

To illustrate the segmented regression analysis approach, 
we analysed data from a previously published study [8] 
that used an ITS design to evaluate the effectiveness of 
a collaborative intervention to improve quality in pre- 
hospital ambulance care for acute myocardial infarction 



(AMI) and stroke at 11 publicly funded ambulance orga- 
nizations in England. A series of weekly measurements 
(the percentage of patients with a pre-hospital diagno- 
sis of AMI and stroke who received a defined care bundle) 
between January 2010 and February 2012 was used to 
measure the impact of the collaborative intervention. The 
six-month pre-intervention period was defined as January 
to June 2010. The authors used logistic regression analysis 
of the data at each site, with the outcome being delivery of 
the care bundle and the predictor being time, modeled in 
two ways: first as a continuous variable across the entire 
study period, and then as a dichotomous indicator repre- 
senting pre- and post-intervention periods. The estimated 
odds ratios (ORs) from the models that specified time 
as a continuous variable were combined across sites using 
fixed effects meta-analysis. The authors concluded that, 
over all sites, the collaborative intervention led to statisti- 
cally significant improvements in ambulance care for AMI 
(OR 1.04 per month, 95% Confidence Interval [CI] 1.04, 
1.04) and stroke (OR 1.06, 95% CI 1.05, 1.07). 

We used the plots of weekly data aggregated across 
sites provided in the additional file [9] to re-analyse the 
data using segmented regression analysis. The details of 
our results are presented in Table 1 and displayed gra- 
phically in Figures 1 and 2. Before the intervention, the 
increase in AMI performance was OR = 1.02 per month; 
after the intervention, there was an additional increase 
of OR = 1.04 (95% CI 0.98 to 1.10) per month, which 
was not statistically significantly different from the pre- 
intervention trend (p = 0.20). Over the entire 86-week 
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Figure 1 Segmented logistic regression analysis of care bundle for AMI: all sites combined. 
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Figure 2 Segmented logistic regression analysis of care bundle for stroke: all sites combined. 



intervention period, the estimated increase in AMI per- 
formance is given by OR = 3.2 (a 220% relative increase); 
in the absence of the intervention, we would have ex- 
pected a 45% increase (OR = 1.45). After accounting for 
the secular trend, the additional improvement associa- 
ted with the intervention would, if it were real, likely be 
clinically important. For stroke, the pre-intervention in- 
crease in performance was OR = 1.05 per month; after 
the intervention, there was an additional effect of OR = 
1.02 (95% CI 0.97 to 1.07) per month, which was not sta- 
tistically significantly different from the pre-intervention 
trend (p = 0.52). Over the entire 86-week intervention per- 
iod, the estimated increase in stroke performance is given 
by OR = 4 (that is, a 300% increase in odds). But even if 
the intervention had not been introduced, we would have 
expected a relative increase of 190% (OR = 2.9). 

Discussion 

A challenge in the use of the ITS design to evaluate com- 
plex quality improvement interventions is that the in- 
tervention may consist of several different components 
introduced at different times. For example, in this study, 
the authors' preliminary investigations suggested that the 
two most effective interventions may be provider prompts 
and individualized feedback, while education and passive 
information dissemination did not appear to bring about 
change. One way to estimate the effects of different in- 
tervention components is to add multiple 'interruptions' 
to the time series, but this requires a sufficient num- 
ber of time points between interventions to allow their 



independent effects to be estimated [4]. In some studies, 
the intervention may need to be phased in or introduced 
gradually over a period of time, before being fully imple- 
mented. Thus, there may be a time lag from the initial 
introduction of an intervention to when its full effects can 
be observed. One way to allow for this in the segmented 
regression analysis is to fit a model with three segments, 
corresponding to the pre-implementation, implementa- 
tion, and post-implementation periods. An alternative is 

Table 2 Segmented logistic regression analysis of care 
bundles for AMI and stroke: all sites combined, allowing 
for a ramp-up period of 12 weeks after introduction of 
the intervention 



Parameter 


Odds 
ratio (OR) 


95% confidence 
interval for OR 


p-value 


AMI 








Pre-intervention slope 
(secular trend, per month) 


1.02 


0.97 to 1 .07 


0.362 


Change in intercept 
(immediate effect) 


1.16 


0.93 to 1 .44 


0.199 


Change in slope 

(gradual effect, per month) 


1.02 


0.97 to 1 .08 


0.346 


Stroke 








Pre-intervention slope 
(secular trend, per month) 


1.05 


1.00 to 1.10 


0.045 


Change in intercept 
(immediate effect) 


0.93 


0.73 to 1.19 


0.577 


Change in slope 

(gradual effect, per month) 


1.02 


0.97 to 1 .07 


0.551 
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to fit the model excluding the time points corresponding 
to the phase-in period [4,10]. Although the authors did 
not specify a phase-in period in their original analyses, 
we explored the effect of allowing for a phased intro- 
duction by censoring the first three months of observa- 
tion after the start of the intervention. The results from 
this analysis are presented in Table 2, and our conclu- 
sions about the effect of the collaborative intervention 
remain unchanged. 

In ITS studies, it is not uncommon to have different 
participating sites contributing data. In our re-analyses 
of these data, we used a single time series of data aggre- 
gated across all sites. An analysis of aggregated data is 
likely to have less power than a multilevel logistic reg- 
ression analysis of the time series from the individual 
sites. Gebski et al. [3] describe how to conduct segmen- 
ted regression analysis when there are multiple sites and 
different intervention start times. One approach is to 
conduct separate segmented regression analyses at each 
site, and then estimate the overall effect by pooling the 
estimates of intervention effect across sites using inverse 
variance weights in a meta- analytical model [11]. Ano- 
ther approach is to fit a single model to the data from 
all sites and account for heterogeneity across sites by in- 
corporating random effects for the sites. 

Sensitivity analyses may be conducted to consider the 
effect of outliers on the results. Outliers may be censored 
from the analyses or modeled explicitly via dummy var- 
iables [2]. Alternatively, the effect of outliers may be re- 
duced by using moving averages. Yet another approach is 
to combine data points prior to analysis, by using, for 
example, bi-weekly instead of weekly measurements. Al- 
though we did not explore these issues in our re-analyses, 
variability in outcomes over time can substantially affect 
power in an ITS study. 

Conclusion 

In conclusion, our results demonstrate the importance 
of using segmented regression analysis in an ITS study. 
When a standard regression analysis is used with time 
modeled as a single continuous variable, an estimate is 
obtained for the slope over time, but it is impossible to 
distinguish the effect of the intervention from the under- 
lying secular trend and to make causal claims about the 
effects of the intervention. Based on our re-analyses of 
these data, we conclude that the quality improvement 
collaborative resulted in no statistically significant im- 
provements in the quality of AMI and stroke care, but 
that potential clinically important effects for AMI cannot 
be ruled out. 
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